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ABSTRACT 



. Opinions and research findings differ oh two 
fundamental aspects about a teacher's impact in the classroom: the 
amount students learn, and the process of instruction. Although 
consensus is lacking, faculty evaluations are widely used by 
administrators in such matters as promotions, tenure, and merit 
increases. Studies of , college students' perceptions- about effective 
, teaching indicate that students emphasize the process of instruction, 
especially the humanistic facets, which are not usually included in 
the criteria for faculty evaluations. Students do not usually rate 
the criteria which are used for end-of-course evaluations. If 
students rated the evaluation criteria at the beginning of their 
course, their instructors would have valuable information on which to 
base adjustments in the development of the course. Student perceived 
validity about the criteria might improve the quality of the 
end-of-course evaluations. Study data indicate that thfe product of 
instruction — amount of learning— is not the primary stfiden-t criterion 
for evaluating professors. Strong implications for administrative use 
of faculty evaluations are suggested by the findings of several 
studies on student evaluation of teaching. (Author/jq) 
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1 "Abstract ; ^ - f 

. » % . • - . . ' * 9 * . 

\ ,., • ■ • J 1 \ • • 

Does effective 'teaching produce learning jn students? Is this a. valid basis 

% * 1 ■ . * % • , 

for evaluating a "teacher's* performance? * There"' seems to be no consensus on 
criteria for evaluating .instruction. In particular,* opinions and research 
-findings differ on two most fundamental aspects abo^t a teacher's impact -in 

the classroom: the amount students. learn and . the process of instruction. * . 

» - « ... 

* * • • 

Although the consensus is missing, faculty evaluations ire widely used -by 
administrators in such matters as promotions, tenure, jnerit 'increases, etc. 
A study of college students 1 perceptions* about effective teaching iifclicates 
that students emphasize'tht process of instruction, especially th£ humanistic 
facets, which are not usually included in the criteria for . faculty evaluations. 
Students are not usually asked to ratethe criterta which they are asked to * 
use for such end-o*f-course evaluations. . If they wereV requested to rate the 
criteria at the beginning of the course, their instructors would have valuable, 
information on which to base adjustments, as indicated, J ri the development of 
the coarse. Student .perceived validity about the crite!\tiftm1ght increase the 
real .quality of the endiof-course evaluations. In any evenjt', the perceptions « : 
revealed in this study indicate that the product of instruction, amount of 
learning* is not th6 primary student criterion for evaluating professors .« 
Strong implications for the administrative use of faculty evaluations are sug- 
gested by the findings of this and other studies on student evaluation of 
teaching. 
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* « . College Students' Perceptions of effective • 

. * ' '• ' . ' 

. . Teaching: Process Over Product . . 

.. • * 4 o ■ * : 

Studiespconcernlng one aspect or the other of teacher effectiveness, or" 
measures of teach tng evaluation, are regularly reported 1n professional jour- 
nals. The consensus of many of these reports 1s that no significantly effec- 
tive way has been found to measure ^effective teaching. Either the, learning 
variable (amount students learn) depends upon low level cognitive achievement 
or longer range effects of "learning cannot be measured. On the other, hand, 
the process of instruction (which has an Indirect effect on learrilng) lhas been 
the focus of evaluation, 1n which case personality and' entertainment factors 
have be^n shown to- effect student perception's on more important aspects of 
the teaching. In few studies has 1t been shown* that teachers are rated \n 
terms of the students', own criteria or rankings on pre-determ1ned criteria, 
however valid they may or may not be. The problem becomes one of trying to. 
determine at least What criteria students use for rating teachers, and then 
to allow them to rate their Instructors against the criterion levels stated 
by the students themselves. 

The timing and use of student feedback to Instructors on the nature and 
effectiveness of the Instruction have been the focus of some of the research 
Initiated with a purpose of Improving the overall -quality and validity of the 
use of student responses for Improving Instruction. 'Another use of student 
Input 1s Important as well. That 1s, administrators use student evaluations 
for the purposfcsOf decisions on tenure, promotion, assignment, salery, etc. 
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Recent studies for the Educational Testing Service bya research psychor 

.% ^ * , • * > 

logist, John Centra, (1975) have sought' to determine greater reliability for 
student evaluation feedback.. In 4 one s,tudy ft was found that feedback received 
at mid-semester, ( along with comparisons of teacher self-evaluation, resulted* 
in adjustments 1n classroom sensitivity by the teacher. More adjustment was 
seen on areas where* greatest discrepancy appea refl between student and teacher 

perceptions*. Feedback received at the end of , the semester showed little or 

-. • • 

no Influence on Instructor adjustments. When additional comparative Informa- * 

• ., • 

tlon was received for the following semester, adjustments became apparent. 
' Student ratings and Instructor self-ratings did not otherwise relate signif- 
icantly to each other. \ \ 

Centra (1973) also studled.the potential permanent Influence of Instructors 
on students by Investigating alumni and college student ratings of the same pro- 
fessors. The findings showed a great dea> of similarity between the two with 
regard to Instructors' whose ratings fe)l Into the highest or lowest categories. 
Centra concludes that the judgments w^ch students make of the teachers at the 
end of the course tend to remain permanent (for five years, at least, since this 
was the length of time for the alumni). 

Certain aspects of teaching may not be pertinent for students to judge, 
according to Centra. Such Items as Instructors' knowledge of his subject arei, 

the validity of reference materials, or the .Intrinsic merits of the course are, 

i „ 
perhaps, best left to be evaluated by colleagues., Ln Centra's studies,"" cdl 4 

leagues tended to rate their peers higher on these Items- than d'ld students. 
Such differences of perception on the same categories Indicate that other re- 
lationships between variables of faculty 4 * evaluation may be studied fruitfully. 

At ETS a study 1s going on of the possible relationships between student 
evaluation responses and a variety of other variables: (1) student achievement; 
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(2) student emulative grade point avtrage; (3) expected grade in the course; 
(4) the potential uses of. feedback, particularly the validity of actual' student 
sincerity of response with regard to the use of evaluation feedback when -only 
for self- improvement or for changes 1n promotion, ^ tenure, salary, .etc. ; (5) in- - 
structor self-evaluation; (6) effects of class size; and (7) required or non- 
required course. .« s ' ■ * 

The use of feedback in the process of improving instruction was the focus 
of a study of perceptions of .teacher behavior as a basis for follow-up training 
procedures (Tuckman, 1976). 'Graduate students, a3m1nistrators and teachers at • 
Rutgers University hated an instructor on 28 pairs of adjectives on a seven-point 
scale in order to determine reliability of some factors which 1 could be used for 
the feedback procedures. Tuckmah found that factor analysis reduced the pairs 
to four factors, labeled creativity, dynamism, organized demeanor, and warmth/ 
acceptance. The procedure for using the feedback is described as a seven-step 
sequence beginning with a team of teachers who volunteer to give others/feed- 
back on their teaching. The participants then state thejr criteria for 'good 1 ' 
teachers on the adjective pairs. The feedback procedure continues with a 
variety of observation and consultation, and training based on the feedback 
received during the sequence. -The^results of this^iystem in two studies are 
reported by Tuclcman (1976) tQ be favorable in terms of quantity "of chafige in 
stydent teachers compared to those who received no* systematic feedback on spe- 
cific criteria. Teachers are encouraged to try out the system with their^bwn 
variations and to contribute theit* results .to the body of knowledge on teacher 
evaluation and the use of feedback for improving instruction., v 

In a study to determine the variance in perception of pupils from different 
socio-economic backgrounds regarding effective teacher characteristics, Tollefson 
(1975) found pupils' perceptions to be independent of their backgrounds. PupilS 
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were agreed on four humanistic factors and one relating, to skill in the presen- 

» 

tation of subject matter. The four personal qualities were tolerance, flexlbl 1- 
ity, respect for students and enthusiasm for teaching. 

Problems of validity are the topic of a summary article about student eval- . 
uations by Rodin (1975) who describes the two current accountability measures re- 
garding 'best' teacher as: 1) teachers with the highest- student ratings; or', 

• 2) those whose students learn the most. The second of the criteria seems to be x 
universally accepted, although notable emphasis can be found on the first! Rodin 
notes that the variables of student evaluations which have been researched show 

.considerable lack of consistency. Many factors ejftraneous to teaching, for in- 
stance,«can significantly affect ratings (such as those being studied by Centra: 
class size, time of day, hard or easy grading styles, etc.). Even forcing stu- 
dents to think seems to have a negative Influence on ratings,' according to Rodin. 
In a study on the effects on students' ratings of teacher .personality related 

* > 

to the content, an actor, Dr. Fox, entertained students using nonsensical content. 
Jhe students rated his class very highly! Ms. Rodin concludes that theatrics 
could become a substitute for academic value or challenge as a means of off- 
setting student boredom in college classes where diligence may be'stressed In- 
stead of ability. • * • 

The other accountability criterion, the amount students learn, raises the 
question, can learning be measured? Another question follows the first: Wtiat 
learning will be measured as the basis of teacher effectiveness? Rodin (1975) 
reports. on one study 1n which the results of a pre-test showing student ignorance 
of the content were used for measuring learning 1n the course. .According to Rodin, 
tests could be ^eslgoed to evaluate achievements of integrated learning, as well as 
learning facts. The drawback to using learning as an .accountability measure, says 
Rodin, Is that meaningful understanding may not be measurable within the limits of 
time In the course, so that student learning measurements might be reduced to their 
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ftodin states that problematic questions arise if evaluation of. teaching 

"has to do with the effect of the teaching on the student. Which effect, for 

example, is the one to be maximized: entertainment, challenge, knowledge, under- 

standing, practical value, etc.? Other areas of potential ly valuable effect 

worthy of being evaluated are: depth of understanding, change in sensibilities, 

openness to new ideas and information in an area, appreciation of learning (of 

a subject, or in general) as a form of life-long activity (for recreation or' 

human survival), tolerance for ambiguity of questions over answers, the habit of 

rationaj thought, and the shucking of parochialism. These, and possibly many 

others, may be suggested as alternative measures of learning to the standard one 

of the amount students learn. The current emphasis in accountability (student-^ 

satisfaction or amount learned) is due to the fact that the responses can be 

quantified, according to Rodin. She concludes, therefore, that we need to search ' 

for better measures and answers as opposed to determining teacher effectiveness 

solely on these two sets of criteria. 

* • 

Discrepancies in conceptions of teacher effect iveness , as described in , 
detail above, may cause anxiety about accountability with regard to decisions 
on promotion, tenfrfe, salary, etc. This was the rationale for a study to deter- 
mine perceptions of teacher effect iveness conducted by Jenkini and Bausdell (1975) • 
The implications were that accountability approaches might.be modified depending 

A. * • 

upon the identification of certain conceptions. The instigators surveyed the 
perceptions of teachers and administrators on the criteria upon whfch teac-hers 
are regularly evaluated: factors of process, product a^d f>resage. 

A survey instrument was developed based upon these categories with a number 
of criteria related to each category. The categories are defined below: 
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1. Product is the measurable'change 'in student behavior. This implies 
valid changes not reached over the years, such as growth in skills, 
knowledge of a specific subject, or attitudes which could be attri- 
buted to the teacher as a model or from direct intervention; 

2. frQcess means the classroom. behavior of teacher; students, or in the 
interaction (verbal behavior, methods, c1assroom a contro1 , individuali- 
zation of instruction, organization, etc*.); • 

3. Presage refers to attributes of teachers 1 (personality, intellectual 
-strength, training backgrognd, years of v teaching, etc.). 

The specific questions ape listed in Appendix A with a table containing 
the findings. Presage was considered an indirect measure of teacher effective- 
ness in that it may Relate to the criteria of process or product. 

Sixteen criteria were used covering the three categories, although not 
•equally distributed. Seven q*iestions related to presage, six to process, and 
two covered product. A nine point scale was used with rankings from "completely 
unijnportant"' to "extremely important. " The assumption was stated that adequate 
measures were available to determine the validity, of the criteria being used. 

Jenkins and Bausdell found considerable/similarity among the rankings of 
alj groups of educators and wi'tfr those of the administrators. (Appendix A.) 
The. highest ranked item was "relationship with-the class," a process category. 
Second ranked was "f lexibi f i ty," a presage item. The means on process were 
relatively equivalent to those on product. Both meaps received jwe re signifi- 

r • * . 

ctfntly higher than the means, on the presage items (7.64 and 7.26 vs 6.43). 1 

P^^rding to'thfc researchers, teachers seem to. feel that *hat they, do 
is important as the effects or outcomes of learning.' The amount students I e*rn 
was not highly rated, having been Van ked 11th out of the sixteen criteria* . 
Since .tjie amount of learning is a prirtie goal of Education, the researchers 
offered a number of probably causes for the low ranking revealed oh -this eri- 
tenon. Teachers may be aware of the importance of learning', tut as it relates 
to hdW it is achieved (process), such as in terms of the cjassroonvatmosphere^ 

teacher behavior, etc* v-There is also the problem of how onejneasures the mu1tf=- 

' r' * . 

tude x>f educational* experiences involved in learning as we)) as determining whith 
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faculty are responsible for the learning. . The conclusion reached 1n this study ' 
was that people being held accountable must be In agreement with those doing / 
the evaluating in terms of the perceptions and the uses of the evaluative criteria. 

This conclusion is reinforced 1n the findings of another study about evalua- 
tion which investigated the reactions of teachers to evaluation depending on its 

0 

purposes. Zelenak and Snider (1975) based' their study on two different phlloso- 

phles about evaluation which seen) to appear in the professional literature: 1) 

evaluation is for administrative purposes (tenure, promotion, merit raises, etc.). 
V t 

and 2) evaluation is the the improvement of instruction. The probTem studied was 
a comparison of attitudes of teachers who believe in either of these two philoso- • 
phies. On all of the three attitude dimensions measured, activity, evaluative and 
potency, the group who believed the administrative ratibnjile for evaluation scored 



significantly lower than those thinking evaluation was for improvement of instruc- 
tion. Zelenak and Snider "cdhclu Jed that teachers in the latter group are suppor- 
tive (devaluation. On the other hand, those who feel that "evaluation is used 
^ for administrative decisions affecting their position, tenure, salary, etc., re- 
gard the evaluation process negatively. Like Jenkins and Bausdell, they state 
that more communication is needed on the uses of, and perceptions about, evalua- 
tion (and the criteria) 1n order to overcome conflicts in, the uses of evaluation 
of teaching. 

Young and Heichberger (f975) also studied perceptions .of teachers regarding 
supervision and purposes of ^upervlsiorv. Urban and rural elementary teachers 
viewed supervision as potentially dangerous in terms of Instruction and teacher 
competency. Eighty-'seven percent of those surveyed desired to have a ljole in the 
supervisory and evaluation process. Supervisors should be aware of teachers' prti^ 
losophy and approaches to Instruction, they reported. A similar majority viewed 
evaluation as a means for determining teacher weaknesses, not for administrative* 
decision, 1ti order to improve instruction through in-service help. 
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The present study of the perceptions of college students on various 
criteria, adapted from the Jenkins and Bausdell study, was an attempt to create 
more communication about evaluative cnteria in the process^ determining 
effective teacher qualities at the uqivrfrsity level. Since the same differ- 
ences in philosophies about evaluation of teaching exist at the college level, 
it might be helpful to determine, from the students themselves, rankings on 
certain criteria against which .instructors may choose to have themselves evaluated 
Baseline data may be establ ished^ for comparisons of student ratings on instructors 
as they may differ among students in different jcol leges. Student inputs received 
at the beginning of the course oh the students' own rankings of the criteria, cou4d 
result, as in the. Centra st*u#, >n^J^^ 

behavior of the teacher. The present study requests student inptit at the <b*~ 
ginning of the quarter and their questionnaires are returned to them at the end^ 
This contrasts with the blind surveys handed out in the present inadequate eval- 
uation system at Florida Technological University. 

Student feedback at the end of the course, related to the students' own 
rankings of the criteria which the instructor is willing to use for the evalua- 
tjon of his/her class, may result 'in changes in subsequent classes or in % ratings. 
The students, having seen and reacted to the criteria to be used in evaluation 
for the course, may change their perceptions of certain criteria during the class 
in which related instructional activities are experienced. The effect may be to 
increase or decrease the perceived val id ity of the activity by the student. 
Another effect may be to increase or decrease the instructor rating on the evalua- 
tion. Comparison with such effects could be made with baseline data resulting 
from the survey to be conducted in this. study. 

The findings of this stud^ can contribute to the fund of knowledge re- 
ported in the previous studies on perceptions of evaluation criteria. The po- 
tential for change indicated in the Centra study would be a healthy outcome 

11 
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of the determination of students' perceptions concerning the criteria they might 

» 

use for evaluation of Instruction. Student Involvement 1n the process" of Instruc- 

# • 

tlon might be increased 1n that students provide Input to teachers at the begin- 
ning of the course. There can be continued monitoring of instruction 1n terms'* 
of the previously stated criteria, and more elucidation of the contexts of learn- 
ing may be generated for the students. Problems 1n student evaluations due to the 
Hawthorne effect might be mitigated somewhat because of students Indicating the' 
Importance of , given criteria at the beginning of the course. 

Method 

Subjects In the Winter Quarter of the 1975-76 .academic year at Florida 
Technological University, one hundred thirty-four students who were enrolled In 
two classes taught 1n the College of Education were selected to participate 1n 
the study. One group of students (N»106) with non-education majors was enrolled 
in an elective class from a variety of education courses offered for upper divi- 
sion students. (Advanced Environmental Studies are a form of upper level required 

4 

general education.) The second group (N*34) was made up of students beginning the 
first phase of their professional teaching program. The groups were designated 
non-ed major and education major students. 

• Procedure During the second. week of classes, the students completed a ques- 
tionnaire containing 14 selected criteria for effective teachers, adapted from a - 
study by Jenkins andBausdell (Appendix B). Students were asked to rate each cri- 
terion on a scale of 1 (low) to 9 (high) in terms of Its importance 1n determining 
teacher effectiveness. Individual questionnaires were coded so that they could be 
used for evaluation of instruction at the end of the course. 

' * Results 

Student responses on the questionnaires were subjected to a frequency dis- 
tribution on all 14 criteria to determine means and standard error of distributian. 

12. 
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Tests were conducted on comparative means and standard deviations with signifi- 
cance required at the .05 level. In addition, student responses were compared 
to data received in the Jenkins and Bausdell study of teacher and administrator 
perceptions. Insufficient data prevented more than examination by inspection,, 
however^ 

The highest rated criterion for both groups was the teacher's knowledge of 
the subject matter (#14). The means for this criterion were 8.67 (ed major) and 
8.42 (non-ed major). The second rank criterion was the teacher's general know- 
ledge of educational facts (#9), and the means were 8.22 (ed major) and 7.88 
(non-ed major). Flexibility of the teacher (#3) was ranked third: 8.16 and 
7.67. Eight of the fourteen criterian were found to be ranked in the upper 
three level^ of importance and four in the mid-range. The lowest ranked criteria 
were the teacher's experience (#5), 3.06 and 4.20* and his/her community and pro- 
fessional activities (#11), 3.74 and 4.24." w , 

Differences between the educatjan and non-education majors were noted on 

each criterion. Significant levels (p<.05) of variance were revealed on cri- 

» 

teria related to: a) teacher flexibility <#3),b) years of teaching experience 
'(#5), c) amount students learn (#10), and d) knowledge of subject matter (#14), 
(Means on all questions are found in Appendix C.) Figure 1 gives a visual dis- 
play of the three sets of ratings on all variables. • 
On the three categories of criteria used in the Jenkins and Ba us dell study, 
student responses dlfftred between education and non-education majors (Table 1), 
although rio^t to be a significant degree. ..Table 11 reveals that education majors 
differed from perceptions reported for the teachers and administrators in the 1 
previous study. Sitice sufficient data were not available, significance levels 
could not be determined. However, inspection of differences, compared with other 
variances which were found statistically significant, strongly supports an assumed 
•significant variance at p<.05 on certain criteria. Students diffe-ed with 
teachers and administrators on most of the individual criteria and by ar much 
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1. Education Major N-31 

2. Non-Educ. Major N-10^-»-*- 
3- Prof. Educators N-23^ mm* 

(Jenkins and Bausdell) 




9 10 11 12 13 \k 



FIGURE I. FOURTEEN CRITERIA OF EFFECTIVE TEACHERS AS PERCEIVED BY 3 GROUPS. 
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7. 
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9. 
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12. 
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Extent to which his/her verbal behavior in classroom Is student-centered. 
Personal adjustment and character. 

Willingness to be flexible, to be di ect or Indirect as situation demands. 
Influence on student's behavior. 
Years of teaching experience. 

Extent to which he/she uses Inductive (discovery) methods. 
Relationship with class (good rapport). 

Effectiveness In controlling the class (hand! Ing discussion, group work, etc.) 
General knowledge and understanding of educational facts. 
Amount his/her students learn. 

Participation In community and professional activities. 
Ability to personalize his/her teaching. 

Capacity to perceive the world from the student's point *f view. 
Knowledge of the subject matter and related areas. 
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as one rating level on several. The students' means were lower on all but three 
variables. (Figure 1) The professionals rated two presage Items, knowledge 
(#$ 9 5 1*0 1 and amount students learn (product) lower than did both college 
groups. All groups reached approximate uniformity on only two criterion: willing- 
ness to be flexible and effectiveness In class control. 

TABLE 1. Means on Categories of Student Perceptions of Qualities of Effective 
Teachers " ' 

Category •* Students ' 

Ed Major Non-E(J Major 

i (N-31 ) (N-IQiQ 

~ Product W .6.&1| 

Process 7-059 , » 6.998 

, Presage 6.39** 6J»72 

Signlf I cance Levels not determined.* ~~ — 

TABLE II. Comparison of Education Students' Perceptions and Teacher/Admin is- 
trators' Perception of Categories of Qualities of Effective Teachers 

Category Perceptions , 

Teacher/Adm. >Ed Major 
(N»23») (N-30 



Product 7T26 6.39 

Process 7.61» 1 7. 06 

Presage 6.^5 6.39 

S i gn i f i cance Levels not determined. 

Discussion 

Cotlege students clearly perceive instruction differently from publ i o- school 
teachers and administrators even though Instruction in college Is, potentially, 

not much different. The perceptions that varied most markedly were those on the 

♦ * 

criteria which are used for much teacher evaluation, that is, the amount students 
learn (product), teachers* knowledge of general and specific content -(presage), 
and influence on student 1 learning behavior (product). Even though professionals 
have considered the product of Instruction, the amount their students learned, to 
be Important, the Jenkins and Bausdell group ranked teachers' rapport with students 
significantly higher. Education majors as students, however, still ranked that 
product criterion above the level of their future peers. They were closer to 
the professionals' perception on the Item than were the non-ed students, however. 

15 
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Interestingly, the education major's rating was closer to the professional per- 
ception on only four criteria compared to the non-educational student! The 
three criteria, 1n addition to V amount of learning, relate to the concept of 
flexible or unstructured teaching: use of Inductive methods, flexibility, and 
personalizing teaching. Perhaps the capacity to perceive Instruction from the 
teacher's point of view takes place after the pre-serv1ce teacher 1s actually 
responsible for Instruction. 

Another of the factors frequently used 1n assessing an Instructor's pro- 
fessional potential or wprth, experience, redeved next to the lowest rating 
among the students and the very lowest by the professionals themselves. In 
addition, the potential effect on students' behavior, as suggested by Rodin, 
was ranked second or third" lowest by both student groups. . 

The purpose of this study was to Investigate, the validity of some criteria 
which college students might use for evaluating the effectiveness of teaching. 
A comparison was made between students with education and non-education majors, 
and between students' perceptions and those reported by public school educators 
on the same criteria. The criteria were categorized Into three types of respon- 
ses, those relating to the product and process of Instruction and presage of the 
teacher.' 

Although similarities were found between both student groups and with pro 
fesslonals' responses 1n terms of the levels on which Individual criteria were 
rated, significant variances were revealed on criteria frequently Included on 
evaluation Instruments. On the Instructor's knowledge of the subject, students 
rated this most Important. Centra has suggested, however, that this quality 1s 
probably best measured by professional peers than by students. 



College Students' Perceptions 

f-, 

15 

The factors of dynamism and warmth in Tuckman's study are reflected in 
the high loadLngs found on presage and process Items In this study. Flexi- 
bility, personalizing teaching, good rapport, and sensitivity to the students 1 
point of Mew all received ratings In the upper third of the scale. The 
humanistic factors studied by Tol lef son are clearly reflected here, as well. 
Interestingly, students rated .the amount they learn, which might validly be 
evaluated by them, lower than the teachers' knowledge, which they would not 
likely be able to evaluate accurately. Other factors, which Rodin suggested as 
valuable for evaluation, were either not studied or received Insignificant 
ratings. The concentration on subject matter In Rodjn's analysis Is clearly 
reinforced by 'the' first choice of. the students.' 

With" regard to the uses of evaluation, as studied by Zelenak and Snider, 
adjustments In teacher behavior will be difficult In termjs of the first two 
choices of the students. On other highly rated Ite/ns, such as flexibility, 

i 

*. • « 

rapport and personal I zing, teaching, adjustment can be more readily seen. In 
the manner that students differed with professional educators on key bases 
for evaluation, agreement on the" measures of effectiveness, as suggested by 
Jenkins and Bausdetl , would be r s^n I {leant for accurate Interpretation of the 
results If adjustments are to be made. Even more Importantly, If student 



evaluations are to be used for critical decisions about a teacher's salary, 
promotion or tenure, closer agreement on" the criteria to be used Is clearly 
Implied by the results of this study of college students perceptions of effec- 
tive teachers. Moreover, students' perceptions about evaluation might be more 
perspicacious, and might val idly reflect their analysis of the conduct of their 
coursesiby knowing ahead of time the criteria for -evaluation as well as the 
agreed upon emphasis of Instruction. For example, If an Instructor concentrates 
his/her efforts on the amount students learn (a factor which the study shows that 
students do not rate as highly as the teacher's knowledge), It could be announced 
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* at the beginning of class to make students aware of the emphasis put on this 

criterion by the Instructor. A person doing a good Job of teaching, then, 
might be rated higher on this criterion, i,as well as the ones which students 
perceived as more Important. 

• An accepted maxim of teaching Is to "take them from what they are." If 
Instructors used student rated criteria for evaluation of teaching, Instructional 
strateglesnmlght be oriented more closely to potential student approaches to 
learning. That students concentrate attention In learning on the subject content 
Is clear from the high rating they put on the Instructor's knowledge of the sub- 
ject. Instructors who believe. jn other modes of learning have an obligation to 
themselves to effectuate transfer of knowledge through other mean's: than the ex- 
position of facts (In very knowledgeable ways, of course). Such teachers may 
feel tha,t students need to develop an expanded base for further learning for 
themselves, ,-^hus, they teach not only content, but methodology as well. There- 

• fore, a- teacher can take students from "where they are" and still fee I "that he/ 
she Is fulfilling professional goals of teaching the subject although with methods 
more preferable to the Instructor. ' 

Whatever variances might exist between teacher and student perceptions on 
effective teacher criteria, this study supports the contention that clear agree-r 
ment should be r ea c W be t w een faculty and nHwlTtlttrgttoil on the relative weight 
which should be given to the student rating's on these and other criteria. Even 
the use or non-use of student Evaluations bears re-examl nation In the light of 
the findings and conclusions reported from other studies on criteria for. Judging 
quaHty of teaching. Recent alterations at' Florida Technological -Un I vers i ty In 
the format for administering faculty evaluations by students suggest that the 
system can be very faulty and that the potential for misuse by faculty and ad- 
ministration Is high. Should students rate Instructors on cr I terla v whlch are 
often not understood slmllajpy by many students or faculty? Shoujd students 
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rate facultySflthout having had training jn such perceptive duties? If faculty 
are t«fcprof1t by student evaluations, and 1f students are to learn to understand 
evaluative criteria better, then having the Instrument examined by students at 
the beginning of the course may be of. value. 

. j 

If, as 1n this study, students' are able to rank criteria 1n terms of the^ 
Importance to them, faculty will' have an opportunity to relate to students 1n 
terms of the latter's perception. Similarly, faculty would have the opportunity 
to develop studenti/ awareness of instructors' perceptions about effectiveness 
and learning strategies. If criteria are^ rated at an earlypolnt and are accept- 
\ ed'for use as a comparison with end-of-course ratings, then faculty would be able 
to use early feedback, possibly, to avoid glaring errors which are normally ev1- 
* dent on end-of-course evaluations. Students, also; Could and should develop a V 
perspective about the evaluative process as the class proceeds because of having 
seen, and rated, the criteria which the Instructor will use for student feedback. 
•Indeed, the students' own perceptions on certain criteria, for example on methods, 
may change after Instruction by a teacher whojGsSd the methods. Further study on 
the possible Influence of Instruction variables- on student perceptions at the ( end * 
*f the course 1s Indicated. 

Finally, the validity of the results *1n this study should be examined through 

1) larger samples- Including education students more advanced In their professlon- 

v * . ♦ * ■ 

al preparation; 2) 'pre*- and post- Instruction sampling of student perceptions; and 
3) surveys which allow students to suggest criteria for ranking In Importance as 
well as being used for* evaluation of Instruction. In this vein, some of the 
Influence on students snggested by Rodin might be worthy of study under con- 
ditions of feedback monitoring. ^ , 
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A. Mean Ratings and Rank Order of 16 Criteria of Effective Teachers. "^^^ 

B. Qualities of the l Effect1ve Teacher. 

C. MeaD Ratings by College Students of Criteria for JEffectlve Teaching. 
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TABLE I 

MEAN RATINGS AND RANK ORDER OF THE 16 CRITERIA' 



Criteria 
(ordered by rating) 

1. Extent to wMch his verbal behavior 
in classrbom is student-centered 

2. Personal adjustment and character 



>• Willingness to be flexible, to be 

dlrett or indirect as situation demands 

K. Influence on^tudent's behavior 

5. Years of* teaching experience 

6. ^ Extent to which >ie uses inductive 

(discovery) methods „ .> 

7« Relationship with class (good rapport) 

8. Effectiveness in controlling his class 

9. General knowledge and understanding 
of educational facts 

10. Amount his students learn 

11. Participation in community and 
professional activities 

12. Ability to personal ize his teaching 

13. Capacity to perceive the world from 
the student's point of view 

1**. ^Knowledge of subject matter and 
related areas 



Type 
(Mitzel Scheme) 



(N-264<) 



Type 

Process 
Product 
Presage 



\ 



Process 
Presage 

Presage 
Product 
Presage 

Process 
Process 
Process 

Presage 
Product 

Presage 
Process 

Process 

Presage 



Combined 

7.6* 
7.26 
6.43 
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Mean 
Rating 



7.27 
7.71 

8.17 
7-65 
3-89 

6.95 
8.31 
»7.88 

6:43 
6.86 

4.88 
7.63 

7.79 



7.64 

•re- 



source: Phi Delta Kappan, vol. 55/.8:573 (April 197*0 
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• APPENDIX B 
SURVEY 

QUALITIES OF THE EFFECTIVE TEACHER* 



* The purpose of this survey Is to determine wh\t cojjege students believe 
•re appropriate bases for judging the effectiveness 



h\t college students bell 
es\o*a teacher. 



Please rate each of the following Items on the nine-point scale provided. 
Assume that adequate measures exist to measure each of the criteria. Try to 
differentiate as much as possible between I terns , Please rate all Items and 
b* sure not to circle more than one rank for any given Item. 

Use the following scale to rate each of the criteria according to Its lm-. 
port an ce In determining teacher effectiveness. Circle one rank for each Item. 
Low ranks are Indicative of unimportant criteria; high ranks-, Important. Five 
Is, of course, average. In the second column, rate your Instructor on each of 
these crlter. (If requested, at, the end of the quarter). 

Your 

Criter ia Validity ' instructor 

Low > High Low High 

1. Extent to which his/her verbal behavior 

In classroom Is student -centered I 2 3 5 6 7 8 9 I2$<*56?89 

2. Personal adjustment and character 123^56789 123U5678S 

3. Willingness to be flexible, to be 
direct or Indirect as sltuatlort 

damends t 2 3 <♦ S 6 7 8 $V 1 23^56789 

Influence on student's behavior I 2 3 k/fZ 7 8 9 I? 3 k 5 6 7 8 9 

5. Years of teaching experience 123^56789 123U56789 

6. Extent to which he/she uses Inductive 

(dlscovery)methods T23U56789 123U56789 

7. Relationship with class (good rapport) 123<»567JB9 123^56789 

8. Effectiveness In controlling the class 

(handling discussion, groop work, etc.) 1 23^56 789 123*456789 

9. General knowledge and understanding of 

educational facts 123456789.1 23*» 5' 6789 

\0s Amount his/her students learn ' 123*456789 | 2 3 4 5 6 7 8 9 

* 

11. Participation in community and * 

professional activities 123*456789 123*456789 

12. Ability to personalize his/her teaching 1 f"3 *» 5 6 7 8 9 123*456789 

13. Capacity to perceive the world from 

the student's point of view 1 231*56789 123*456789 

1*4. Knowledge of the subject matter and 

related areas • 1231*56789 123*»5'6789 

^Adapted from Phi Delta Kappan, April I97*», p. 572-3 

Dr. David W. Gurney 
Secondary Education 
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Mean Ratings by College Students of Criteria For Effective Teaching 

Criteril ^. Major Nori-ed Major 

, (N-31) (N-104) — 

1. Extent to which his/her verbal behavior 

In classroom is student-centered 6.54 6 73 

2. Personal adjustment and character ► 6.48 6 50 ' 

3. Willingness to be flexible, to be 

direct or indirect as situation demands 8. 16 7.67 

4. Influence on student's behavior 5.64 

5. Years of teaching experience 3,06 

6. Extent to which he/she uses fnductive 
(discovery) methods 6.03 

7. Relationship with class (good rapport) 7. 80 ^ 

8. Effectiveness in controlling the class 
(handling discussion, group work, etc) 7.62 7.64 

9. General knowledge and understanding of 
educational facts 8 22 

10. Amount his/her students learn 7. 12 

c 11. Participation in community and 

professional activities 3.74 

12. Ability to personalize his/her teaching 7.32 

13. Capacity to perceive the wprld from the 
student's point of view " » . 7^3 



14. Knowledge of the subject mattei agd 
related areas 



Adapted from Phi Delta Kappan, April 1974, p. 572-3 



5.91 
4.20 



5.76 
7.93 



7.88 
7.70 

4.24 
6.80 



7.10 

8.67 8.43 
(Scale: 1-9) 
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